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Abstract - We propose a way to incorporate the effect of a specific class of feedback processes 
into stochastic thermodynamics. These "Maxwell demon" feedbacks do not affect the system 
energetics but only the energy barriers between the system states (in a way which depends on 
the system states). They are thus of a purely informational nature. We show that the resulting 
formalism can be applied to study the thermodynamic effect of a feedback process acting on 
electron transfers through a junction. 



Introduction. — Our understanding of nonequilib- 
rium statistical mechanics has significantly improved over 
the last fifteen years, in large part due to our ability to 
accurately manipulate small fluctuating systems operating 
far from equilibrium [Tj2] . At the theoretical level, the dis- 
covery of fluctuation theorems (see the reviews [3}j5] and 
references therein) and the fundamental new accomplish- 
ments in stochastic thermodynamics [6 - 10 have played a 
major role in this respect. In view of these developments, 
it is therefore not so surprising that we are witnessing a 
regained interest in the study of the intricate connections 
between information and thermodynamics 
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recog- 
nized long ago by pioneers such as Szilard, Landauer, Ben- 
nett, and many others (most of these early works can be 
found in Ref. [25]). What seemed rather abstract and un- 
realistic considerations have nowadays become experimen- 
tally relevant questions 26-29 . This is particularly true 



when describing systems undergoing feedback processes. 
In this paper, we propose to incorporate the effect of a 
specific class of feedback process (which we call "Maxwell 
demon" feedbacks) in the formalism of stochastic ther- 
modynamics and analyze its consequence on the study of 
thermodynamic efficiencies. 

In stochastic thermodynamics, any system described by 
a Markovian stochastic dynamics can be shown to satisfy 
a "mathematical" second law of thermodynamics. This 
means that the Shannon entropy of the system can be 
separated into two contributions, an always positive con- 
tribution which only vanishes when detailed balance is sat- 
isfied (i.e., all probability currents between system states 



vanish), and a remaining entropy flow contribution. Es- 
tablishing the first law requires the key assumption of local 
detailed balance: in its simplest form the logarithm of the 
ratio between a forward and backward transition rate due 
to a given reservoir v is given by the energy difference 
between the states involved in the transition in units of 
k^T v . This translates the fact that the mechanisms gen- 
erating the transitions between system states are external 
reservoirs at equilibrium. Under these circumstances, the 
entropy flow can be directly connected to the energy flows 
in the system and the "mathematical" second law becomes 
the physical second law of thermodynamics. In this pa- 
per, we show that the local detailed balance assumption 
can be modified to account for the effect of a specific class 
of feedback processes which do not affect the energetics of 
the system, but only modify the energy barriers between 
system states. Ideally, such feedbacks do not require any 
work to function since the energy for crossing the barriers 
is provided by the reservoirs. They only use the "informa- 
tion" or "knowledge" of the state of the system to adjust 
the energy barriers accordingly. Thanks to the modified 
notion of local detailed balance, systems subjected to such 
feedbacks can still be analyzed within the powerful frame- 
work of stochastic thermodynamic and the effect of these 
feedbacks on the thermodynamic properties of the sys- 
tem can be systematically investigated. Such a theory 
is particularly useful to differentiate between general and 
system specific features. We apply our formalism to the 
study of an electronic Maxwell demon model proposed in 
Ref. 30 . In the spirit of previous studies on the efficiency 
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of small devices operating far from equilibrium 15,31-39 , 
we study the efficiency with which the feedback can gen- 
erate heat or matter fluxes in directions forbidden by the 
second law in absence of feedbacks. 



Stochastic dynamics with "Maxwell demon" 
feedback. — We consider a system in contact with var- 
ious reservoirs v at fixed temperature T v and chemical 
potential [i v . The discrete system states are denoted by 
m and have an energy e m and number of particles N m . 
Transitions betweens systems states are triggered by the 
reservoirs. The probability for the system to be on the 
state to evolves according to the Markovian master equa- 
tion 
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The rates satisfy ^2 m W mm ' = (due to probability con- 
servation) and contain contributions from different reser- 
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We assume that the system 



voirs v. W„ 

is subjected to a class of feedbacks that do not affect the 
energetics of the system but only its kinetic properties. 
These "Maxwell demon feedbacks" are assumed to mod- 
ify the local detailed balance property of the rates in the 
following way 
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The feedback parameters /, 
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N m and are such that fmm 
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cannot depend on e m and 

and /w = -fm'm- In 
absence of feedback, f^m' = 0) we recover the standard 
local detailed balance property which is generic for system 
interacting with fast equilibrium reservoirs and is known 
to lead to a consistent thermodynamic description of the 
The form ([2| implicitly assumes that the feed- 
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system 

back acts by controlling some physical parameters present 
in the rates on timescales much faster than the system 
and much slower than the reservoirs. It imposes a weak 
constraint on the explicit form of the rates which can as- 
sume very different form depending on the system under 
consideration. To fix our ideas, let us consider as a first 
example Arrhcnius rates 
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where B^ m , * s the ener §y barrier between state m! and m 
when the transition is caused by the reservoir v. We see 
that the feedback parameter turns out to be the differences 
between the energy barriers from state m to m! and from 
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In absence of feedback, f^L, = because the energy bar- 
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Fig. 1: (Color Online) Illustration of how a feedback, by mod- 
ifying the potential landscape separating two well defined po- 
tential wells, could lead to a discrete description in term of 
Arrhenius rates |3|. The sketched full (dashed) potential land- 
scape corresponds to transitions described by W mm i (W m i m ). 



rier have to be the same in both directions. The feedback 
acts exclusively on the energy barriers and leaves there- 
fore the system energies unaltered (see Fig. [T]). We call 
these feedbacks " Maxwell demon feedbacks" because they 
can be seen picturesquely as resulting from a Maxwell de- 
mon which is able to instantaneously tune the values of 
the energy barriers whenever at least one given transition 
occurs. As a second example we consider "Fermi golden 
rule" rates resulting from a weak interaction between the 
system and fermionic or bosonic reservoirs at equilibrium. 
Assuming (without loss of generality) that for fermions 
N m > = N m — 1 and for bosons e m > < e m , one obtains 
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where depending on the particle species, 77 denotes the 
Fermi or Bose distribution n(x) — (e x ± l)" 1 (in the 
latter case the chemical potentials vanish), respectively, 
and the r^; m 's are related to tunneling amplitudes be- 
tween states. In absence of feedback, these are symmet- 
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The feedback process consists again 



in modifying the tunneling amplitudes depending on the 
state of the system. Using ([2| , we find that the feedback 
parameters are expressed in terms of the tunneling rates 
as 
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Stochastic thermodynamics with feedback. 

We now consider the stochastic thermodynamic de- 
scription of a system subjected to the above described 
"Maxwell demon feedbacks". We are going to show that, 
in contrast to a standard thermodynamic forces, such feed- 
backs do not affect the first law of thermodynamics but do 
enter the second law. The energy and number of particles 
in the system are given by 
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Since the total energy and number of particles are con- 
served and since " Maxwell demon feedbacks" do not affect 
the system energies and number of particles, the energy 
and matter balance reads 

E = \d x E + Y,I [ E ] , N = \d x N + J2lu > - ( 8 ) 



The first term on the right hand side is the standard form 
of the entropy flow in absence of feedback. The second 
term is the information current due to the feedback and 
reads 

i F = y: iP , = h £ nitwit ■ (is) 



The first contribution on the right hand side accounts for 
changes induced by an external work source whose ef- 
fect on the system energies, e m (A), and number of par- 
ticles, N m (X) (this latter case seems however unlikely), is 
parametrized by A. The second contribution accounts for 
the energy and matter currents entering the system from 
reservoir v 

4"° = T l W^l Pm >(e m -e m ,) ) 



I { m ] = E W { ±, P m'{N m -N ml ). (9) 



The energy balance can be rewritten as the first law of 
thermodynamics 



(10) 



where the work flow contains a mechanical and chemical 
component 



(") 

M 



(11) 



and where the heat flow with reservoir v is given by 

CW=jM-^/M. (12) 

The crucial result up to this point is that the first law 
remains unaffected by the feedback. We now turn to the 
system entropy which is given by the Shannon entropy 



S = -fa^^P™ lnp„ 



(13) 



The entropy balance reads 

S = S e + S h (14) 
where the entropy production is given by 



and the entropy flow by 
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Using the modified local detailed balance property ([2]), 
this latter can be expressed as 



(17) 



Obviously, while " Maxwell demon feedbacks" do not affect 
the energy and matter balance they do affect the entropy 



balance. Using (17), we can rewrite (14 1 as 



Si = s - 



I F >0. 



(19) 



This is a central result of this paper. In absence of feed- 
back, Ip = 0, it is well known that entropy production can 
be interpreted as a "total entropy" because it can be seen 
as the sum of the entropy change in the system, S 1 , and 
the entropy changes in the reservoirs. Indeed, the entropy 
change in an ideal (i.e., reversible) reservoir v is given by 
the heat flowing into it divided by its temperature, i.e., 
S v = —QS U >/T V . As a result, the positivity of S\ implies 
that S > J2 U Q( v ' /T u which is the traditional second law 
of thermodynamics. In presence of feedback, depending 
on the sign of If this result need not hold anymore. The 
entropy production S\ can still be interpreted as the "to- 
tal entropy" , but in addition to the change in the entropy 
of the system and the reservoirs, it also needs to contain 
the entropy change provided by the feedback mechanism, 
Ip. The notion of equilibrium is always defined by S\ = 0, 
since it still corresponds to the situation where detailed 
balance is satisfied and where as a result all currents van- 
ish Ip = Im = Ip = [4l] . The results obtained so far 
are summarized in Table [I] in order to facilitate their inter- 
pretation. Each element constituting the total system is 
subjected to a given change in energy, matter and entropy. 
We clearly see that while "Maxwell demon feedbacks" do 
not modify the energy and matter balance, they do affect 
the entropy balance. This summary also reveals an inter- 
esting duality between the work source and the "Maxwell 
demon". While the former is an idealized source of en- 
ergy without associated entropy generation, the latter is 
an idealized source of entropy without associated energy 
changes. 

Without going into details which have been often re- 
ported elsewhere (see e.g. 42 or 43 ), it is clear that the 



dynamics we considered implies a fluctuation theorem for 
the entropy production defined at the trajectory level 

/ e -(A,S)/fe 6 \ = ( c -(AS-£„Q (,y) /T„+F)/fc^ = ^ ^ 

where F is the integrated information current Ip defined 
at the trajectory level. This integral fluctuation theorem 
is the analog of the fluctuation theorems derived in [14] for 
systems subjected to feedback and in contact with a single 
reservoir (in this latter case AS* - Y, v Q {u) l T v = (W - 
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Total energy conservation: E + Eyy + YLu E u = — » Eq. M 
Total matter conservation: N + N w +J2 I/ N ll = -> Eq. (M) 
Total entropy production: Sj = S + X)„ ft + Sd > -> Eq. ( 
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Table 1: Illustration of each element constituting the total system. The table lists their respective energy, matter and entropy 
change. 



AF)/T). We note that the detailed fluctuation theorem 
also holds. The backward dynamics is identical to the 
forward dynamics and is subjected to the same "Maxwell 
demon" feedback as the forward dynamics in contrast to 
detailed fluctuation theorems obtained for other feedbacks 
which act by an external (time dependent) control of the 
rates 
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From now on we will focus on nonequilibrium steady 
state situations and consider for simplicity the case of 
two reservoirs v — L,R. This means that due to energy 
and matter conservation we have Ie.m = I^em = ~^e m- 
Since furthermore i n ste ady state one has S = 0, it follows 
that Si = — S e and (19) becomes 









Ml \ 


Ik 






Tl) 



ft 



In an isothermal system T = Tl 



M 



I F > 0. 



(21) 

Tr for example, as- 



suming that /ir > Eq. (21 1 becomes 

Si = -^+I F >Q, (22) 
where the extracted power is given by 

V = -W = J2 Q {V) = fan. - »l)Im- (23) 



In absence of feedback, the matter flux can only flow down 
the chemical potential gradient (i.e., Im < 0). However, 
in presence of feedback, if Ip is sufficiently positive, the 
matter flux can climb up the chemical gradient (i.e., Im > 
0) and lead to positive extracted power with an efficiency 



Th 



= 1 - 



ft 
If 



A similar analysis can be done in absence of a chemical 
potential gradient /i = hl — ^jlr and assuming that Tl > 
Tr. In this case, entropy production (21 1 becomes 



Si 



Tp, 



If > 0, 



(25) 



where rjc = 1 — Tr/Tl is the Carnot efficiency. Thanks 
to the feedback, heat could flow from lower to higher tem- 
perature (i.e., Qr — — Ql > 0) and cool the cold reservoir 
with an efficiency 



V = 



TrIf 




(26) 



As a final example, we mention that the feedback could 
also be used to improve the efficiency of a thermoelectric 
generator. To see this, we assume that Tl > Tr and 



Mfl — Ml an d rewrite (21 1 as 
V 



Si 



Tr ^ Tr ~* 



+ If>0. 



(27) 



The thermoelectric effect occurs when V > 0. In ab- 
sence of feedback, this requires heat from the hot reservoir 
QS L ' > 0. The efficiency of this thermal engine is usually 
defined by 



V 



Tr{I f - Si) 



which, for Ip — 0, is upper-bounded by rjc- We easily see 
that the feedback can be such that this efficiency increases 
beyond Carnot efficiency. The reason is that the power 
generation is not only powered by the heat from the hot 
reservoir but also by the information flow resulting from 
( 24 ) the feedback. 
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Single level quantum dot with feedback. We 

now turn to the thermodynamic analysis of a model sys- 
tem, proposed in Ref . [30] , which consists of a single level 
quantum dot in contact with two fermionic reservoirs and 
subjected to a Maxwell demon feedback. The dot can be 
empty (m = 0) or filled (m = 1) and the rates describing 
the reservoir-induced transitions between these states are 
given by 



W$=T v n v {e) 



w$ = r>^ [i 



n„(e)] , (29) 



where the Fermi distribution is given by 
n„(e) = (e x » + l)" 1 and i„ = (e - /i„)/(fc 6 T„). The 
local detailed balance condition modified to include the 
feedback effect therefore reads 



In Ww 



(30) 



If p denotes the probability to find the dot filled, at 
steady state we find p = Wio/(Wio + Woi)- We intro- 
duce the steady state probability current (which for this 
example is equal to the matter current Im) 
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W w + Woi 
where we defined the affinity 
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in terms of 8f = /h — ft and Sx = xt 
may also be written more explicitly as 
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fJ-L 
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(32) 

xr. The affinity 
-UR-h). (33) 



The heat and matter current are proportional in this 
model / = Im = Ie/c- This is the so-called tight cou- 



pling property. Since f v = — —f^Q 1 , the information 
current ( |l~8| ) becomes If — kbSfl and is thus also pro- 
portional to /. The three currents (matter, energy and 
information) are thus tightly coupled. As a result, the 
entropy production can be written as a single collapsed 
affinity A times the current /: 



f {") 



Si = k b AI = k b (Sf-5x)I. 



(34) 



We will restrict our analysis to the isothermal regime 
T = Tr = Tl, where the feedback is used to generate 
power by pumping electrons against the bias. In this case 



the power ( 23 ) can be written as 



V = k b TSxI = k b T(6f - A) I 



(35) 



and the efficiency for generating this power ( 24 1 becomes 

A 

w 



5x 

v= sf = 1 



(36) 




Fig. 2: (Color Online) The feedback pumps electrons against 
the bias (isothermal leads) thus generating power. For maxi- 
mum power versus A and Xl, the efficiency (top), power (mid- 
dle), and affinity (bottom) of the process is plotted as a func- 
tion of Sf and fn,. All quantities are dimensionless except 
power which is expressed in Ffc^T with r = Tl = Tr. 



At equilibrium, A — 0, the efficiency reaches its upper 
bound rj = 1. Since close to equilibrium, the current be- 
comes linear in the affinity, I = LA, we observe the well 
know result that rj — 1 corresponds to V = 0. We there- 
fore turn our attention to the efficiency at maximum power 
with respect to A. In the linear (to affinity) regime, the 
maximum occurs at the affinity A* — 6f/2 and thus leads 
to the well known result (for models with tight coupling) 
that the efficiency at maximum power rf in the linear re- 
sponse regime is half of the ideal equilibrium efficiency, i.e., 
rf = 1/2 31 . To study the efficiency at maximum power 
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beyond linear response, we need to resort to numerics. 
Generally, even for equal tunneling rates r = Tl = Tr, 



power in Eq. (35 ) will still depend on Xt,/r and Jl/r- Us- 
ing Sf = fa — Jl, Sx = xl — xr, and Eq. (32 1, we choose 
to eliminate these in favor of Sf, Xl, and Jr. Maximiz- 
ing the power numerically with respect to both A and Xl, 
the maximum power P* still depends on Jr and Sf. On 
figure [2] we therefore plot, as a function of Sf and Jr, the 
efficiency, power and affinity corresponding to the power 
maximum obtained by maximization versus A and xt, ■ We 
clearly see that close to equilibrium at low affinities (cor- 
responding to small Sf), we recover the universal 1/2 be- 
havior. We also see that the efficiency at maximum power 
in the nonlinear regime can become much larger (respec- 
tively smaller) than 1 /2 for large (respectively low) values 
of f R . 

Summary and Outlook. — We considered nonequi- 
librium systems subjected to "Maxwell demon" feedbacks, 
i.e., feedbacks which do not affect the system energetics 
but only the energy barriers between system states, and 
showed that their thermodynamic properties can be stud- 
ied using the theory of stochastic thermodynamics by ex- 
tending the traditional local detailed balance as described 
in Eq. ([2]). We demonstrated that these feedbacks may 
be used to convert information into work, to cool a cold 
reservoir, or to increase the standard efficiencies of heat to 
work conversion above Carnot efficiency (since in this lat- 
ter case it is actually heat and information in combination 
that are converted to work). Using a simple model system 
introduced in 30] , we also studied in detail the efficiency at 



maximum power of information to work conversion. Gen- 
eralizing the present rate equations-based scheme to quan- 
tum master equations (not reducible to rate equations) is 
an interesting venue for future research. 
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